The efficacy of ultrasonography on learning curve and inter-subject performance variability in radial artery cannulation in standardized training for residents: a randomized controlled trial.

AIM: To evaluate the effect of ultrasound (US) on learning curve and inter-subject performance variability of residents in radial artery cannulation. MATERIAL AND METHODS: Twenty non-anesthesiology residents who received standardized training in an anesthesiology department were selected and divided into two groups: anatomy group or US group. After training of relevant anatomy, US recognition and puncture skill, residents selected 10 patients either under US or anatomical localization performing radial artery catheterization. The number and time of successful cases of catheterization were recorded, success rate of first attempt and catheterization, as well as the total success rate of catheterization were calculated. The learning curve and inter-subject performance variability of residents were also calculated. Complications and the residents' satisfaction for teaching and self-confidence before puncture were also recorded. RESULTS: Compared to the anatomy group, total success rate and the success rate at first attempt were higher in US-guided group (88% vs. 57%, 94% vs. 81%). The average performance time in the US group was significantly less (2.9±0.8 min vs. 4.2±2.1 min) and the mean number of attempts was 1.6, while 2.6 for the anatomy group. With performing cases increasing, the average puncture time of residents in the US group decreased by 19s, while 14s in the anatomy group. More local hematoma occurred in the anatomy group. The satisfaction and confidence degree of residents were higher in US group ([98.5±6.5] vs [68.5±7.3], [90.2±8.6] vs [56.3±5.5]). CONCLUSION: US can significantly shorten the learning curve, reduce the inter-subject performance variability, improve the first attempt and total success rate of radial artery catheterization for non-anesthesiology residents.

Impact of Rater Training on Residents Technical Skill Assessments: A Randomized Trial.

OBJECTIVE: The ACS/APDS Resident Skills Curriculum's Objective Structured Assessment of Technical Skills (OSATS) consists of task-specific checklists and a global rating scale (GRS) completed by raters. Prior work demonstrated a need for rater training. This study evaluates the impact of a rater-training curriculum on scoring discrimination, consistency, and validity for handsewn bowel anastomosis (HBA) and vascular anastomosis (VA). DESIGN/ METHODS: A rater training video model was developed, which included a GRS orientation and anchoring performances representing the range of potential scores. Faculty raters were randomized to rater training or no rater training and were asked to score videos of resident HBA/VA. Consensus scores were assigned to each video using a modified Delphi process (Gold Score). Trained and untrained scores were analyzed for discrimination and score spread and compared to the Gold Score for relative agreement. RESULTS: Eight general and eight vascular surgery faculty were randomized to score 24 HBA/VA videos. Rater training increased rater discrimination and decreased rating scale shrinkage for both VA (mean trained score: 2.83, variance 1.88; mean untrained score: 3.1, variance 1.14, p = 0.007) and HBA (mean trained score: 3.52, variance 1.44; mean untrained score: 3.42, variance 0.96, p = 0.033). On validity analyses, a comparison between each rater group vs Gold Score revealed a moderate training impact for VA, trained κ=0.65 vs untrained κ=0.57 and no impact for HBA, R1 κ = 0.71 vs R2 κ = 0.73. CONCLUSION: A rater-training curriculum improved raters' ability to differentiate performance levels and use a wider range of the scoring scale. However, despite rater training, there was persistent disagreement between faculty GRS scores with no groups reaching the agreement threshold for formative assessment. If technical skill exams are incorporated into high stakes assessments, consensus ratings via a standard setting process are likely a more valid option than individual faculty ratings.

Improving Resident Knowledge of Ergonomics Guidelines.

OBJECTIVE: To improve resident knowledge of ergonomics guidelines for surgery, vaginal deliveries and repairs, and documentation. PROJECT SUMMARY: We consulted with a licensed occupational therapist at our institution regarding our difficulties with maintaining proper ergonomics while operating, performing deliveries, and documenting. We conducted two separate sessions: one in the obstetrics workroom regarding techniques to improve the ergonomics of our documentation and one in the operating room and labor and delivery unit to address techniques to avoid injury and promote long-term wellness. The sessions were conducted during morning report at our institution, and the obstetrics and gynecology teams attended both sessions. The sessions were available by videoconference for the entire residency program. Handouts were created to present basic ergonomics guidelines and were provided at the conclusion of the sessions. The handouts summarized the information provided during the sessions and included recommendations for adjustments that could be made in the workroom, operating room, and delivery room. The sessions were conducted during ACOG Wellness Week. OUTCOME: Adjustments were made in the obstetric and gynecology team workrooms to improve ergonomic function. Sessions improved resident knowledge of ergonomics recommendations for vaginal deliveries. Recommendations included guidelines for arm and shoulder position, tucked chins, and appropriate bed height (sitting vs standing). Adjustments were made in the workroom to position the top of the monitor just below eye level and arm's length away, and chairs were adjusted so that the keyboard and mouse height were just below elbow height. Residents were encouraged to keep arms and wrists in a relaxed, neutral position and to sit all the way back in the chair with back supported and feet firmly on the floor. Residents improved their knowledge of ergonomics guidelines and increased awareness of posture and positioning both on the labor and delivery unit and in the operating room. RELEVANCE TO WOMENS HEALTH OR PHYSICIANS IN PRACTICE: Work-related musculoskeletal disorders are prevalent among surgeons and can have a significant effect on productivity and career longevity. If we are able to implement evidence-based guidelines developed by high-quality ergonomics research, we can potentially protect obstetricians and gynecologists from injury and improve overall wellness.

Impact of Bedside Rounding on Attending Teaching Evaluations.

OBJECTIVE: To examine associations between bedside rounding (BSR) and other rounding strategies (ORS) with resident evaluations of teaching attendings and self-reported attending characteristics. METHODS: Faculty from three academic medical centers who attended resident teaching services for ≥4 weeks during the 2018-2019 academic year were invited to complete a survey about personal and rounding characteristics. The survey instrument was iteratively developed to assess rounding strategy as well as factors that could affect choosing one rounding strategy over another. Survey results and teaching evaluation scores were linked, then deidentified and analyzed in aggregate. Included evaluation items assessed resident perceptions of autonomy, time management, professionalism, and teaching effectiveness, as well as a composite score (the numeric average of each attending's scores for all of the items at his or her institution). BSR was defined as spending >50% of rounding time in patients' rooms with the team. Hallway rounding and conference room rounding were combined into the ORS category and defined as >50% of rounding time in these settings. All of the scores were normalized to a 10-point scale to allow aggregation across sites. RESULTS: A total of 105 attendings were invited to participate, and 65 (62%) completed the survey. None of the resident evaluation scores significantly differed based on rounding strategy. Composite scores were similar for BSR and ORS (difference of <0.1 on a 10-point scale). Spearman correlation coefficients identified no statistically significant correlation between rounding strategy and evaluation scores. An exploratory analysis of variance model identified no single factor that was significantly associated with composite teaching scores (P > 0.45 for all) or the domains of teaching efficacy, professionalism, or autonomy (P > 0.13 for all). Having a formal educational role was significantly associated with better evaluation scores for time management, and the number of lectures delivered per year approached statistical significance for the same domain. CONCLUSIONS: Conducting BSR did not significantly affect resident evaluations of teaching attendings. Resident perception of teaching effectiveness based on rounding strategy should be neither a motivator nor a barrier to widespread institution of BSR.

[Feedback on the first three years of application of the reform of the third cycle in oncology]. / La phase socle en oncologie : retour d'expérience sur les trois premières années d'application de la réforme du troisième cycle.

Since the establishment of the reform of medical studies' third cycle in 2017, the first two residency semesters define the "phase socle" whose objective is to provide the basic knowledge of the specialty. We have carried out a declarative survey, submitted in 2020 to all French residents in Oncology whose "phase socle" had taken place during the first 3 years of the reform. The main objectives of this survey were to evaluate the theoretical teaching of oncology as well as the practical hospital training provided during this phase. The response rate was 44% (among 355 residents, 155 answered). In terms of theoretical training, the level of satisfaction with the national teaching courses of the Collège National des Enseignants en Cancérologie and the distant learning courses on the SIDES-NG platform was considered satisfactory (average visual analog scale of 6.7/10 and 5.7/10, respectively). There was greater heterogeneity in the organization of local courses, of which only 50% of base phase residents benefited. In terms of practical training, the training value of the medical oncology and radiation oncology residencies was good (visual analogue scale 7.9/10 and 6.7/10, respectively), with educational objectives adapted to the base phase, but with a greater workload for medical oncology. This study provides feedback that shows the success of this reform in oncology. It also offers suggestions, which could be the basis to improve the formation of oncology residents.

For the People and the Profession.

In 1982 Dean Warren delivered the presidential address "Not for the Profession… For the People" in which he identified substandard surgical residency programs graduating residents who were unable to pass American Board of Surgery exams. Drs. Warren and Shires as members of the independent ACGME began to close the substandard programs in order to improve surgical care for average Americans i.e. "for the people". By 2003 these changes dramatically reduced the failure rate for the ABS exams and trained good surgeons who could operate independently however the residents were on duty for every other or every third night. In 2003 the ACGME mandated duty hour restrictions in order improve resident wellness and improve the training environment for the profession. However, work hour restrictions reduced the time surgical residents spent in the hospital environment primarily when residents had more autonomy and had exposure to emergency cases which degraded readiness for independent practice. Surgical educators in the 2 decades after the work hour restrictions have improved techniques of training so graduates could not only pass the board exams but also be prepared for independent practice. Surgical residency training has improved by both the changes implemented by the independent ACGME in 1981 and by the work hour restrictions mandated in 2003. Five recommendations are made to ensure that Dr Warren's culture of excellence in surgical training continues in an environment that enhances wellbeing of the trainee i.e. "For the People and the Profession".

Frontline Reporting from the Epicenter of a Global Pandemic: A Survey of the Impact of COVID-19 on Plastic Surgery Training in New York and New Jersey.

BACKGROUND: Since the first documented case of coronavirus disease of 2019 (COVID-19), the greater New York City area quickly became the epicenter of the global pandemic, with over 500,000 cases and 50,000 deaths. This unprecedented crisis affected all aspects of health care, including plastic surgery residency training. The purpose of this study was to understand the specific impact of the COVID-19 pandemic on plastic surgery residencies. METHODS: A survey of all plastic surgery residency training programs in the greater New York City area was conducted. The impact to training during the peak months of infection (March and April of 2020) was evaluated using resident education as measured by case numbers, need for redeployment, and staff wellness as primary outcome variables. RESULTS: A total of 11 programs were identified in the region, and seven programs completed the survey, with a response rate 63.6 percent. When comparing productivity in March and April of 2019 to March and April of 2020, a total decrease in surgical volume of 64.8 percent (range, 19.7 to 84.8 percent) and an average of 940 (range, 50 to 1287) cancelled clinic visits per month were observed. These decreases directly correlated with the local county's COVID-19 incidence rates (p = 0.70). A total of 83 percent of programs required redeployment to areas of need, and correlation between local incidence of COVID-19 and the percentage of residents redeployed to non-plastic surgical clinical environments by a given program (ρ = 0.97) was observed. CONCLUSION: As the first COVID-19 wave passes the greater New York area and spreads to the rest of the country, the authors hope their experience will shed light on the effects of the ongoing COVID-19 pandemic, and inform other programs on what to expect and how they can try and prepare for future public health crises.

Which Aspects of the CanMEDS Competencies are Most Valued in Radiologists? Perspectives of Trainees From Other Specialties.

PURPOSE: Radiologists work primarily in collaboration with other healthcare professionals. As such, these stakeholder perspectives are of value to the development and assessment of educational outcomes during the transition to competency-based medical education. Our aim in this study was to determine which aspects of the Royal College CanMEDS competencies for diagnostic radiology are considered most important by future referring physicians. METHODS: Institutional ethics approval was obtained. After pilot testing, an anonymous online survey was sent to all residents and clinical fellows at our university. Open-ended questions asked respondents to describe the aspects of radiologist service they felt were most important. Thematic analysis of the free-text responses was performed using a grounded theory approach. The resulting themes were mapped to the 2015 CanMEDS Key Competencies. RESULTS: 115 completed surveys were received from residents and fellows from essentially all specialties and years of training (out of 928 invited). Major themes were 1) timeliness and accessibility of service, 2) quality of reporting, and 3) acting as a valued team member. The competencies identified as important by resident physicians were largely consistent with the CanMEDS framework, although not all key competencies were covered in the responses. CONCLUSIONS: This study illustrates how CanMEDS roles and competencies may be exemplified in a concrete and specialty-specific manner from the perspective of key stakeholders. Our survey results provide further insight into specific objectives for teaching and assessing these competencies in radiology residency training, with the ultimate goal of improving patient care through strengthened communication and working relationships.

Vascular and Endovascular Surgical Procedural Skills Training: Survey of Vascular Surgery Program Directors About Extracurricular Vascular Surgical Educational Courses for Vascular Trainees.

BACKGROUND: Over the past decade, there has been an increase in the number of Vascular Surgery Educational Courses (VSEC) provided by academic institutions, regional and national vascular surgical societies, as well as industry partners. Each course has its own curriculum and how these curricula align with the modern needs of vascular surgery trainees are unclear. As such, there is a lack of unified content, syllabus, and trainee evaluations/feedback of these courses. The Education Committee for the Association for Program directors in Vascular Surgery (APDVS) was tasked to survey vascular surgery Program directors (PDs) and Associate Program directors (APDs) across the country to investigate the educational value, utility, and feedback provided from these VSEC. METHODS: A comprehensive list of vascular surgery educational courses across the country was generated. A 21-question survey was constructed and forwarded to all members of APDVS. The survey was directed at obtaining data from the vascular surgery program director/associate program directors about their understanding of the VSEC and what they valued as critical for their trainees. In addition, we sought to gauge the feedback provided by these courses to the vascular surgery trainees, and their PD/APDs. RESULTS: The survey was sent to 170 active members of APDVS with an overall response rate of 41%. The majority of the respondents 57 (81%) were PDs. Of all the PD/APDs, 5 (7%) reported that they knew of less than 5 such programs, 26 (37%) reported knowledge of 6-10 courses, 20 (29%) reported 11-20 courses, and 19 (27%) reported knowing more than 20 such programs. 49 (70%) of those surveyed reported that their trainees benefit from these courses. Statisticallysignificant factors impacting the decision to make adjustments to the individual training program included PGY-5 residents attending the educational courses, feedback from VSEC, and positive feedback from trainees attending the courses (all P < 0.05). When asked about their wants of VSEC, 35% desired mock oral exams, and 31% looked for cadaver dissections. Of the 24 PD/APD's who made adjustments to their program based on the feedback from the educational programs, those who held the title for 5-10 years were the most willing to make any changes 13 (54%), and those with more than ten years of experience 2 (8%), were the least willing to make any changes (P < 0.05). The majority of the PD/APDs 32 (46%) felt that the regional societal meetings are the best place to hold educational courses. 38 (55%) of PD/APD's received no feedback from the VSEC course directors. 41 (59%) of the programs provide some financial support for their trainees to attend these courses and 65 (92%) of the PD/APDs suggest that industry partners should provide the financial support for attending VSEC. CONCLUSIONS: This unique survey explores the attitude of vascular surgery educators about outside vascular surgery educational courses offered by various groups and industry. It is important to create standardized curricula for vascular surgery educational courses with collaborative oversight by educational/simulation key opinion leaders, PD/APD's, course directors and industry partners. Exploring benchmarks for standardization of the curricula offered by these outside educational opportunities would streamline the needs of our vascular surgery trainees and minimize time away from home institutions. Feedback identifying vascular trainees' strengths and areas for improvement to PD/APDs would be of great educational value and is currently a missed opportunity.

Longitudinal Reliability of Milestones-Based Learning Trajectories in Family Medicine Residents.

Importance: Longitudinal Milestones data reported to the Accreditation Council for Graduate Medical Education (ACGME) can be used to measure the developmental and educational progression of learners. Learning trajectories illustrate the pattern and rate at which learners acquire competencies toward unsupervised practice. Objective: To investigate the reliability of learning trajectories and patterns of learning progression that can support meaningful intervention and remediation for residents. Design, Setting, and Participants: This national retrospective cohort study included Milestones data from residents in family medicine, representing 6 semi-annual reporting periods from July 2016 to June 2019. Interventions: Longitudinal formative assessment using the Milestones assessment system reported to the ACGME. Main Outcomes and Measures: To estimate longitudinal consistency, growth rate reliability (GRR) and growth curve reliability (GCR) for 22 subcompetencies in the ACGME family medicine Milestones were used, incorporating clustering effects at the program level. Latent class growth curve models were used to examine longitudinal learning trajectories. Results: This study included Milestones ratings from 3872 residents in 514 programs. The Milestones reporting system reliably differentiated individual longitudinal patterns for formative purposes (mean [SD] GRR, 0.63 [0.03]); there was also evidence of precision for model-based rates of change (mean [SD] GCR, 0.91 [0.02]). Milestones ratings increased significantly across training years and reporting periods (mean [SD] of 0.55 [0.04] Milestones units per reporting period; P < .001); patterns of developmental progress varied by subcompetency. There were 3 or 4 distinct patterns of learning trajectories for each of the 22 subcompetencies. For example, for the professionalism subcompetency, residents were classified to 4 groups of learning trajectories; during the 3-year family medicine training period, trajectories diverged further after postgraduate year (PGY) 1, indicating a potential remediation point between the end of PGY 1 and the beginning of PGY 2 for struggling learners, who represented 16% of learners (620 residents). Similar inferences for learning trajectories were found for practice-based learning and improvement, systems-based practice, and interpersonal and communication skills. Subcompetencies in medical knowledge and patient care demonstrated more consistent patterns of upward growth. Conclusions and Relevance: These findings suggest that the Milestones reporting system provides reliable longitudinal data for individualized tracking of progress in all subcompetencies. Learning trajectories with supporting reliability evidence could be used to understand residents' developmental progress and tailored for individualized learning plans and remediation.

Implementation and Evaluation of Quality Improvement Training in Surgery: A Systematic Review.

OBJECTIVE: The aim of this study was to review and appraise how quality improvement (QI) skills are taught to surgeons and surgical residents. BACKGROUND: There is a global drive to deliver capacity in undertaking QI within surgical services. However, there are currently no specifications regarding optimal QI content or delivery. METHODS: We reviewed QI educational intervention studies targeting surgeons or surgical trainees/residents published until 2017. Primary outcomes included teaching methods and training materials. Secondary outcomes were implementation frameworks and strategies used to deliver QI training successfully. RESULTS: There were 20,590 hits across 10 databases, of which 11,563 were screened following de-duplication. Seventeen studies were included in the final synthesis. Variable QI techniques (eg, combined QI models, process mapping, and "lean" principles) and assessment methods were found. Delivery was more consistent, typically combining didactic teaching blended with QI project delivery. Implementation of QI training was poorly reported and appears supported by collaborative approaches (including building learning collaboratives, and coalitions). Study designs were typically pre-/post-training without controls. Studies generally lacked clarity on the underpinning framework (59%), setting description (59%), content (47%), and conclusions (47%), whereas 88% scored low on psychometrics reporting. CONCLUSIONS: The evidence suggests that surgical QI training can focus on any well-established QI technique, provided it is done through a combination of didactic teaching and practical application. True effectiveness and extent of impact of QI training remain unclear, due to methodological weaknesses and inconsistent reporting. Conduct of larger-scale educational QI studies across multiple institutions can advance the field.

Perspectives of Stakeholders About an Early Result Acceptance Program to Complement the Residency Match in Obstetrics and Gynecology.

Importance: The residency application process is flawed, costly, and distracts from the preparation for residency. Disruptive change is needed to improve the inefficiencies in current selection processes. Objective: To determine interest in an early result acceptance program (ERAP) among stakeholders in obstetrics and gynecology (OBGYN), and to estimate its outcome in future application cycles. Design, Setting, and Participants: Surveys of stakeholders in March 2021 queried interest in ERAP across the US. Respondents included OBGYN residency applicants, members of the Association of American Medical Colleges Group on Student Affairs, OBGYN clerkship directors, and residency program directors. Statistical analysis was performed from March to April 2021. Exposures: Respondents completed surveys sent by email from the Association of American Medical Colleges (to OBGYN applicants and members of the Group on Student Affairs), the Association of Professors of Gynecology and Obstetrics (to clerkship directors), and the Council on Resident Education in Obstetrics and Gynecology (to program directors). Main Outcomes and Measures: Applicants and program directors indicated their interest in participating in ERAP, and clerkship directors and members of the Group on Student Affairs indicated their likelihood of recommending ERAP using a 5-point Likert scale. Results: Respondents included 879 (34.0%) of 2579 applicants to OBGYN, 143 (50.3%) of 284 residency program directors, 94 (41.8%) of 225 clerkship directors, and 51 (32.9%) of 155 student affairs deans. The majority of respondents reported being either somewhat or extremely likely to participate in ERAP, including 622 applicants (70.7%) and 87 program directors (60.8%). Interest in ERAP was independent of an applicant's reported board scores, medical school type, race, number of applications submitted, or number of interviews completed. Among program directors, those at university programs were more likely to participate. Stakeholders supported a limit of 3 applications for ERAP, to fill 25% to 50% of residency positions. Estimating the outcome of ERAP using these data suggests 26 280 to 52 560 fewer applications could be submitted in the regular match cycle. Conclusions and Relevance: Stakeholders in the OBGYN application process expressed broad support for the concept of ERAP. The majority of applicants and programs indicated that they would participate, with potentially substantial positive impact on the application process. Careful pilot testing and research regarding implementation are essential to avoid worsening an already dysfunctional application process.